Representation of overlapping visual entities

ABSTRACT

Various embodiments present a combined visual entity that represents overlapping visual entities. The combined visual entity can include a primary visualization that represents one of the overlapping visual entities and annotations that represent others of the overlapping visual entities. For example, a map view can include multiple geographical entities that overlap. A primary visualization can be rendered that represents one of the multiple geographical entities. The primary visualization can be visually annotated (e.g., with symbols, letters, or other visual indicators) to indicate others of the multiple geographical entities. In some embodiments, a zoom operation can cause visual entities to be added and/or removed from the combined visual entity.

RELATED APPLICATIONS

This application is a continuation of and claims priority to U.S.application Ser. No. 14/699,104, filed on Apr. 19, 2015, entitled“REPRESENTATION OF OVERLAPPING VISUAL ENTITIES,” which is a divisionalof and claims priority to U.S. application Ser. No. 13/826,617, filed onMar. 14, 2013, entitled “REPRESENTATION OF OVERLAPPING VISUAL ENTITIES,”now issued U.S. Pat. No. 9,043,723, which is a continuation of andclaims priority to U.S. application Ser. No. 12/764,798, filed on Apr.21, 2010, entitled “REPRESENTATION OF OVERLAPPING VISUAL ENTITIES,” nowissued U.S. Pat. No. 8,423,902, the disclosures of which areincorporated in their entirety by reference herein.

BACKGROUND

Due to the massive amount of data available for consumption in today'selectronic environment, data visualization can be problematic. Forexample, a mapping application can have access to a multitude oflocations (e.g., restaurants, banks, hotels, parks, and so on) that canbe displayed as part of a map view. The sheer number of locationsavailable for display, however, can cause a particular map view tobecome cluttered and reduce the usability of the map view.

SUMMARY

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

Various embodiments present a combined visual entity that representsoverlapping visual entities. The combined visual entity can include aprimary visualization that represents one of the overlapping visualentities and annotations that represent others of the overlapping visualentities. For example, a map view can include multiple geographicalentities that overlap. A primary visualization can be rendered thatrepresents one of the multiple geographical entities. The primaryvisualization can be visually annotated (e.g., with symbols, letters, orother visual indicators) to indicate others of the multiple geographicalentities. In some embodiments, a zoom operation can cause visualentities to be added and/or removed from the combined visual entity.

In some embodiments, overlapping visual entities are grouped into acluster that can be opened to reveal individual visual entities thatform the cluster. According to one or more embodiments, a cluster isrepresented on a map by a visual representation known as a foundation. Auser can interact with the foundation to cause the cluster to be openedto reveal a flyout that includes individual visual entities that formthe cluster. In some embodiments, the visual entities can representgeographical locations in a map view. A user can also interact with anindividual visual entity of the flyout to acquire more information aboutthe visual entity.

BRIEF DESCRIPTION OF THE DRAWINGS

The same numbers are used throughout the drawings to reference likefeatures.

FIG. 1 illustrates an operating environment in which various principlesdescribed herein can be employed in accordance with one or moreembodiments.

FIG. 2 illustrates how a cluster of visual entities can be visualized inaccordance with one or more embodiments.

FIG. 3 illustrates how a foundation can be expanded to reveal a flyoutin accordance with one or more embodiments.

FIG. 4 illustrates how a foundation can be used to illustrate a clusterin a street view scenario in accordance with one or more embodiments.

FIG. 5 illustrates how interaction with a flyout can cause informationabout a flyout entity to be presented in accordance with one or moreembodiments.

FIG. 6 illustrates how interaction with a flyout can cause informationabout a flyout entity to be presented in accordance with one or moreembodiments.

FIG. 7 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 8 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 9 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 10 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 11 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 12 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 13 illustrates how overlapping data sets can be visualized inaccordance with one or more embodiments.

FIG. 14 illustrates an example combined visual entity in accordance withone or more embodiments.

FIG. 15 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 16 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 17 is a flow diagram that describes steps in a method in accordancewith one or more embodiments.

FIG. 18 illustrates an example system that can be used to implement oneor more embodiments.

DETAILED DESCRIPTION

Overview

Various embodiments present a combined visual entity that representsoverlapping visual entities. The combined visual entity can include aprimary visualization that represents one of the overlapping visualentities and annotations that represent others of the overlapping visualentities. For example, a map view can include multiple geographicalentities that overlap. A primary visualization can be rendered thatrepresents one of the multiple geographical entities. The primaryvisualization can be visually annotated (e.g., with symbols, letters, orother visual indicators) to indicate others of the multiple geographicalentities. In some embodiments, a zoom operation can cause visualentities to be added and/or removed from the combined visual entity.

In some embodiments, overlapping visual entities are grouped into acluster that can be opened to reveal the individual visual entities thatform the cluster. A visual entity can represent a data entity, such as ageographical location, a business, a residence, an instance of content,a data file, and so on. In some example operating scenarios, overlappingvisual entities can represent geographical locations on a map that arecombined to form a cluster, and the cluster can be opened to reveal theindividual geographical locations that form the cluster. In at leastsome embodiments, the cluster can be opened independent of a zoomoperation. According to one or more embodiments, a cluster isrepresented on a map by a visual representation known as a foundation. Auser can interact with the foundation to cause the cluster to be openedto reveal a flyout that includes individual visual entities (e.g.,geographic locations) that form the cluster. A user can also interactwith an individual entity of the flyout to acquire more informationabout the entity. In at least some embodiments, user interaction caninclude hovering operations, proximity operations (e.g., userinteraction within a certain proximity of a foundation or other entity),clicking operations, keyboard selection operations, touch operations,and the like.

In the discussion that follows, a section entitled “OperatingEnvironment” is provided and describes one example environment in whichone or more embodiments can be employed. Following this, a sectionentitled “Example Cluster Visualizations” describes how clusters ofentities can be visualized in accordance with one or more embodiments.Next, a section entitled “Constructing and Interacting with Clusters”describes how a cluster can be formed and how a visualization of acluster can be interacted with in accordance with one or moreembodiments. Following this, a section entitled “Representation ofOverlapping Visual Entities” describes how a combined visualization canbe used to visually indicate overlapping data sets in accordance withone or more embodiments. Last, a section entitled “Example System”describes an example system that can be utilized to implement one ormore embodiments.

Consider now an example operating environment in which one or moreembodiments can be implemented.

Operating Environment

FIG. 1 illustrates an operating environment in accordance with one ormore embodiments, generally at 100. Environment 100 includes a computingdevice 102 having one or more processors 104, one or morecomputer-readable storage media 106 and one or more applications 108that reside on the computer-readable storage media and which areexecutable by the processor(s). The computer-readable storage media caninclude, by way of example and not limitation, all forms of volatile andnon-volatile memory and/or storage media that are typically associatedwith a computing device. Such media can include ROM, RAM, flash memory,hard disk, removable media and the like. One specific example of acomputing device is shown and described below in FIG. 18.

In addition, computing device 102 includes a software application in theform of a web browser 110. Any suitable web browser can be used examplesof which are available from the assignee of this document and others. Inaddition, computer-readable storage media 106 can include a layermanager 112 and a cluster manager 114 that are configured to operate asdescribed below. Each of layer manager 112 and cluster manager 114 canbe implemented as a standalone component that can be utilized byapplications 108 and/or browser 110. Alternately or additionally, layermanager 112 and/or cluster manager 114 can be implemented as part ofapplications 108 and/or browser 110. Examples of Applications 108 caninclude a mapping platform (e.g., utilizing 2D and/or 3D maps), anoperating system, a file explorer, and so on.

In operation, layer manager 112 handles layers of data for theapplications 108. For example, a mapping application can includemultiple layers of map data that can be used to populate a map view.Each of the multiple layers can include different types of entities andmap data. For example, a first layer may include restaurants, a secondlayer may include educational institutions, a third layer may includelocations defined by an end-user, and so on. In some embodiments,multiple layers can be overlaid, one on another, to create a particularmap view. To manage layer data, layer manager 112 is configured tohandle a variety of different tasks, such as tracking a location for avisual entity, maintaining different visual forms for a visual entity,managing the z-order (e.g., layer order) of different layers and/orvisual entities, and so on.

In at least some embodiments, cluster manager 114 works in a mappingcontext to enable various visual entities to be grouped into a cluster.A visual entity can represent a data entity, such as a geographicallocation, an instance of media content, a data file, and the like. Thecluster manager can group visual entities into a cluster by determiningoverlap between visual entities in a particular display region. When aparticular group of visual entities overlap by at least a thresholdamount, the group of visual entities can be formed into a cluster.Overlap can be measured using a variety of different metrics, such asscreen pixels, world-coordinates (e.g., GPS coordinates, latitude,longitude, and so on), street addresses, and so on. Example ways ofdetermining overlap are discussed below.

According to some embodiments, layer manager 112 and cluster manager 114are configured to interact and communicate to group visual entities intoclusters and to place visual entities and clusters in a particulardisplay view. Layer manager 112 can provide cluster manager 114 withdifferent types of information that can be used by the cluster managerto create and manage clusters. Examples of this information include:

Entity list: This is a list of visual entities and/or data entities in aparticular system. For example, in a map scenario, this can include alist of geographic entities and visual representations of the geographicentities that are available to populate a map.

Visible entities: This is a list of the visual entities that are in acurrent view. For example, this may include geographical entities thatare represented in a current map view.

Existing clusters: This is a list of clusters that are currently inexistence.

Visual entities: This includes a location and dimension for each visualentity. For example, this information may include a location (e.g., inscreen coordinates) and a dimension (e.g., in pixels relative to thescreen coordinates) of a visual entity.

Z-order: This includes a z-order for visual entities, clusters, and/orlayers in a particular system. For example, a particular visual entitycan have a z-order that indicates that the entity is to be displayedabove (e.g., occlude) other visual entities in a display view.

Entity status: This indicates changes in entity status for a particularrender pass. For example, this information can indicate that an entitywas added, removed, or changed z-order for a particular render pass. Insome embodiments, the term “render pass” refers to a re-draw of entitiesin a display view. A render pass can occur responsive to changes in adisplay view, such as a zoom operation, the addition or removal ofentities, a change in cluster membership, and so on.

Layer Membership: This indicates which entities belong to which layerand an order for each of the layers in a layer set.

In some embodiments, cluster manager 114 can receive some or all of thisinformation from layer manager 112, process the information, andgenerate further information that can be passed back to the layermanager to populate a particular display view. Examples of this furtherinformation can include:

(1) Updated entity list: This can include an updated list of entities(including cluster entities) and a list of entities that were removedfrom existing clusters.

(2) Entity layers: This can include a list of layers that includeentities included in clusters.

(3) Cluster membership: This can include an indication of a clustermembership for an entity.

(4) Entity change: This can include an indication of visual entitiesand/or clusters that should be added or removed from a display view.

(5) Cluster z-order: This can include a z-order for entities in aparticular cluster.

(6) Visual elements: This can include a visual representation to be usedto represent a cluster. In some embodiments, each of multiple clusterscan be associated with a unique visual representation.

In addition the above-mentioned features, environment 100 includes anetwork 116, such as the Internet, and one or more web sites 118 fromand to which content can be received and sent. Such content can includemap content that can be operated upon by layer manager 112 and/orcluster manager 114, as described above and below. It is to beappreciated and understood that the layer manager and/or the clustermanager can reside on a server or network-accessible computer, otherthan computing device 102.

Computing device 102 can be embodied as any suitable computing devicesuch as, by way of example and not limitation, a desktop computer, aportable computer, a handheld computer such as a personal digitalassistant (PDA), cell phone, a mobile device, and the like.

Although not expressly illustrated in FIG. 1, environment 100 caninclude a plug-in framework (e.g., embodied on computing device 102)that enables developers, programmers, and other parties to utilize thetechniques and processes discussed herein in separate implementations.

Having described an example operating environment, consider now adiscussion of example clusters in accordance with one or moreembodiments.

Example Cluster Visualizations

FIG. 2 illustrates one example way in which multiple overlapping visualentities can be visualized as a cluster in a mapping context inaccordance with one or more embodiments. A map view 202 displays a groupof visual entities and includes a map region 204. A map view 206illustrates a map view that is displayed after a zoom-out operationoccurs on map view 202. The map view 206 includes map region 204 as wellas additional visual entities. As illustrated in map view 206, theincrease in the map scale resulting from the zoom-out operation hascaused visual entities within map region 204 to be grouped together suchthat some visual entities visually occlude other visual entities.

Further illustrated in FIG. 2 is a map view 208 that includes map region204 and a foundation 210. In accordance with some embodiments,foundation 210 is a visual representation of a cluster that is createdusing visual entities from map region 204. Thus, the overlapping groupof visual entities displayed in map region 204 of map view 206 can bereplaced with foundation 210. Foundation 210 can represent a unifiedvisual representation that a user can interact with to view visualentities included in the cluster and to find out more information aboutthe visual entities.

In some embodiments, a visualization for a foundation can be defined foran application by an application developer and/or the visualization canbe selected by an end-user. Thus, at least in some embodiments, avisualization for a foundation is customizable to provide a uniquevisual appearance for a cluster.

FIG. 3 illustrates one example way in which user interaction with afoundation can reveal visual entities that form a cluster in accordancewith one or more embodiments. A map view 300 includes the foundation 210discussed above with reference to FIG. 2. At a map view 302, a user hasplaced a cursor over the foundation 210 (e.g., by manipulating thecursor with a mouse), which has caused a flyout 304 to replacefoundation 210. Flyout 304 includes visual entities that form thecluster represented by foundation 210. As illustrated, the visualentities are tied together as part of flyout 304 by graphic lines,indicating that the visual entities represent clustered entities andthat the visual entities may not be displayed at a correct location foran underlying data entity.

In some embodiments, a visualization for a flyout can be defined for anapplication by an application developer and/or the visualization can beselected by an end-user. Thus, at least in some embodiments, a flyoutvisualization is customizable to provide a unique visual appearance forvisual entities in a cluster.

At a map view 306, the user has moved the cursor away from flyout 304,thus causing flyout 304 to be replaced with foundation 210. Thus, insome embodiments, foundation 210 and flyout 304 have a dynamicrelationship that responds to user interaction with the foundationand/or the flyout.

FIG. 4 illustrates one example way of using a foundation to represent acluster in a street view paradigm in accordance with one or moreembodiments. As part of FIG. 4 are a street view 400 and a foundation402. In some embodiments, street view 400 is a two-dimensionalapproximation of a three-dimensional view. For example, street view 400can approximate the view of a person who is traveling (e.g., walking ordriving) along a street. In the street view context, some visualentities can occlude other visual entities. For example, if severalvisual entities are located at the same address (e.g., in an officebuilding), the visual entities can become cluttered and some of thevisual entities can partially or totally occlude others. Thus, afoundation/flyout combination (represented by foundation 402) can beused to represent a cluster of visual entities at a particular locationin street view 400.

In some embodiments, the design of a foundation and/or flyout can beconfigured to convey meaning in a particular context. For example, avisualization for a foundation can include a building at a particularlocation and an associated flyout can include a map of differentlocations within the building.

FIG. 5 illustrates one example way of interacting with a foundation toview visual entities in a cluster in accordance with one or moreembodiments. At 500, a foundation 502 is illustrated. As discussed aboveand below, in some embodiments a foundation is a visual representationof clustered entities. At 504, user interaction with foundation 502causes an underlying cluster to open and reveal a flyout 506. At 508,user interaction with a visual entity 510 reveals information aboutvisual entity 510. In this particular example, the information isincluded in a popup window 512.

At 514, user interaction with the popup window 512 causes the popupwindow to expand and reveal further information about the visual entity510. In this particular example embodiment, the further informationincludes selectable links that can be selected to navigate tofunctionality associated with the represented entity.

FIG. 6 illustrates an alternative embodiment of a foundation/flyoutcombination in accordance with one or more embodiments. At 600, afoundation 602 is displayed that represents a cluster of visualentities. In this particular example embodiment, foundation 602 isannotated to indicate aspects of one or more of the visual entities ofthe underlying cluster. For example, foundation 602 includes an “R”which indicates that one of the entities is a restaurant, a “C” whichindicates that one of the entities is a coffee shop, and a “P” whichindicates that one of the entities is associated with parking.

At 604, user interaction with foundation 602 causes a popup window 606to be displayed. At 608, a user interacts with the popup window 606.According to some embodiments, user interaction with popup window 606can include causing a cursor to hover over the popup window. At 610, theuser interaction with popup window 606 causes the popup window to expandto reveal more information about visual entities included in the clusterrepresented by foundation 602. In this particular example embodiment,the information includes a scrollable list of business entities that arepart of the cluster. At 612, user interaction with one of the listedbusiness entities causes popup window 606 to be populated with moreinformation about the business entity.

Constructing and Interacting with Clusters

FIG. 7 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. The method discussed with reference toFIG. 7, in addition to any other of the methods discussed herein, can beimplemented in connection with any suitable hardware, software, firmwareor combination thereof. In at least some embodiments, aspects of themethods discussed herein can be implemented by software modules, such aslayer manager 112 and/or cluster manager 114 discussed in FIG. 1. It isto be appreciated and understood that the methods discussed herein canbe performed by a suitably-configured server, a network-accessiblecomputing device, and/or a client computing device.

Step 700 ascertains visual entities that are available in the system tobe displayed. For example, in a mapping scenario, the visual entitiescan represent geographical locations that can occur in a particular mapview. The visual entities can be stored at a local resource (e.g.,computing device 102) and/or available from a remote resource. Step 702determines a location for each visual entity in the system. In someembodiments, the location may be in terms of screen location (e.g.,screen coordinates), real-world location (e.g., GPS coordinates, streetaddress, latitude/longitude coordinates, and so on), computer directorylocation, and so on. Step 704 determines that a group of visual entitiesforms a cluster. Example ways of performing step 704 are discussed inmore detail below. Step 706 renders a visual representation of thecluster. Example visual representations of a cluster are discussed above(e.g., a foundation) and below.

According to some embodiments, a data entity can opt in or opt out ofthe clustering process. For example, when a particular data entity optsinto the clustering process, a visual entity that represents the dataentity will be considered when determining clusters. When a particulardata entity opts out of the clustering process, however, a visual entitythat represents the data entity will be omitted when determiningclusters.

As an illustration of this notion, consider the following exampleimplementation scenario involving a tourist attraction data entity. Whenthe tourist attraction registers with a particular data layer (e.g., tobe included in a map), the tourist attraction provides an indicationthat it is opting out of the clustering process. When the clusteringprocess is performed for a map region where the tourist attractionoccurs, the tourist attraction is not considered in forming a cluster.Thus, according to some embodiments, the clustering process wouldnormally group a visual representation of the tourist attraction withother visual entities to form a cluster. Since the tourist attractionhas opted out of the clustering process, however, a visualrepresentation of tourist attraction is not included as part of acluster, e.g., as part of a foundation. Thus, in some embodiments, avisual representation of the tourist attraction can be renderedseparately from an adjacent foundation.

FIG. 8 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. In some embodiments, the method can beimplemented to form a cluster that includes multiple visual entities.Step 800 sorts visual entities to determine x-coordinate overlap. Insome embodiments, a configurable x-coordinate threshold overlap can bespecified that can be used to determine if two or more visual entitiesoverlap such that they can be members of a cluster. For example, withrespect to x-coordinate overlap, a threshold overlap of N pixels can bespecified. When two or more visual entities overlap by N pixels or moreas projected on an x-axis, the visual entities can be considered anx-pass group for purposes of a preliminary cluster determination. Insome embodiments, the acts of sorting discussed above and below can beaccomplished in linear time using a linear sort algorithm (e.g., Radixsort).

Step 802 determines x-pass groups based on collections of visualentities that exceed an x-coordinate overlap threshold. As illustratedin the projection from step 802, the entities within box 804 and box 806exceed an x-pass overlap threshold and thus are grouped as x-passgroups. Step 808 sorts the x-pass groups by y-coordinate overlap.

Step 810 forms clusters using x-pass groups that include collections ofvisual entities that exceed a y-coordinate overlap threshold. Aconfigurable threshold y-coordinate overlap can be specified or thethreshold x-coordinate overlap discussed above can be utilized insorting the x-pass groups by y-coordinate overlap. As illustrated in theprojection from step 810, a cluster 812 and a cluster 814 have beenformed as a result of step 810.

In some embodiments, a maximum number of visual entities permitted in acluster can be specified. For example, a maximum of 5 visual entitiesper cluster can be specified. If a cluster exceeds the maximum number ofvisual entities, the cluster can be broken up into separate clustersand/or visual entities can be removed from the cluster until it reachesthe maximum size. Although not expressly illustrated in FIG. 8, a finalstep can be performed whereby clusters that exceed a maximum number ofvisual entities can be broken up into multiple clusters (e.g., two ormore smaller clusters) and/or visual entities can be removed from acluster that exceeds a maximum number of visual entities. In someembodiments, visual entities that are removed from a cluster can bedisplayed separately from a foundation.

FIG. 9 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. In some embodiments, the method can beimplemented to form a cluster that includes multiple geographicentities. Examples of geographic entities include street addresses,businesses, residential locations, and so on. Step 900 determinesgeographic coordinates for each geographic entity of a collection ofgeographic entities. Examples of geographic coordinates include latitudecoordinates, longitude coordinates, GPS coordinates, and so on. Step 902forms a cluster that includes geographic entities with matchinggeographic coordinates. One example way of performing step 902 is tocompute a hash value using geographical coordinates for each geographicentity. For example, a one-pass linear bucketing of the geographicalcoordinates can be performed. Geographic entities with identical and/orsimilar hash values are then grouped together to form a cluster.

Step 904 renders a visual representation of the cluster. According tosome embodiments, this method of forming clusters can be useful in astreet view scenario (see, e.g., the discussion above with respect toFIG. 4) to form clusters using geographical entities that occur at thesame or similar location (e.g., a particular street address).

The methods discussed herein for determining entity overlap and/orforming clusters are provided for purposes of example only and are notto be interpreted as limiting the claimed subject matter. It is to beappreciated that a variety of different methods and techniques can beutilized to form clusters without departing from the spirit and scope ofthe claimed embodiments. For example, some techniques can simply look atpixel occlusion, some can consider the shape of entities in forming acluster (e.g., utilizing a shape collision detection algorithm), and soon.

While certain embodiments are discussed herein with respect to formingclusters based on entity overlap, some embodiments can additionally oralternatively form clusters utilizing entities that are like or similarin nature. For example, some clustering techniques can form clustersusing similar entities, such as a restaurant cluster, a touristattraction cluster, a coffee shop cluster, and so on. Thus, in someembodiments, a cluster-forming technique can consider the proximityand/or overlap of entities and can also consider the nature of each ofthe entities. For example, if two entities are of disparate types (e.g.,one is a restaurant and the other is a sporting goods store), the twoentities may not be included in the same cluster.

FIG. 10 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. In some embodiments, the method can beimplemented to cluster and/or de-cluster entities in response to a zoomoperation. Step 1000 receives an indication of an initiation of a zoomlevel change. According to some embodiments, step 1000 can be performedresponsive to user interaction with a zoom (e.g., zoom-in or zoom-out)function. Step 1002 ungroups visual entities that form a first cluster.In some embodiments, the first cluster can be ungrouped responsive toreceiving the indication of the zoom level change. Step 1004 receives anindication of completion of the zoom level change. In some embodiments,the zoom level change can include a zoom-in and/or a zoom-out operation.

Step 1006 determines whether or not the visual entities form a cluster.Example ways of determining that visual entities form a cluster arediscussed above and below. If the visual entities form a cluster(“Yes”), step 1008 renders a visual representation of a second cluster.In some embodiments, the second cluster may include the same visualentities as the first cluster, fewer visual entities than the firstcluster, or more visual entities than the first cluster. If the visualentities do not form a cluster (“No”), step 1010 renders separate visualentities.

FIG. 11 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. Step 1100 renders a foundation. In someembodiments, the foundation includes a visual representation of acluster. Step 1102 receives an indication of a user interaction with thefoundation. Examples of user interaction with a foundation are discussedabove and below. Step 1104 renders a flyout. In some embodiments, aflyout can be rendered responsive to receiving the indication of theuser interaction with the foundation and/or the flyout can replace thefoundation in a display view. Step 1106 receives an indication of afocus shift away from the flyout. For example, a cursor that is hoveredover the flyout can be moved away from the flyout. In some embodiments,and responsive to receiving the indication of the focus shift away fromthe flyout, the method can return to step 1100.

FIG. 12 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. In some embodiments, the method can beimplemented to present information about a visual entity included in acluster. Step 1200 renders a flyout. Step 1202 receives an indication ofa user interaction with a visual entity included in the flyout. Examplesof user interaction are discussed above and below. Step 1204 presentsinformation about the visual entity responsive to receiving theindication of the user interaction.

A number of optional variations and additions to the methods andtechniques discussed herein can be implemented to account for variousoperating scenarios. The following is a non-exclusive list of exampleoptional variations and additions.

(1) The determination of visual entities to include in a cluster can bemade using visual entities that are included in a display view during acurrent render pass.

(2) When a z-order for a visual entity or a cluster changes during arender pass, the z-order in existing clusters simply needs to beupdated.

(3) When a change during a render pass simply involves the addition of avisual entity, determine if there is overlap of the added visual entitywith existing visual entities.

(4) When a change during a render pass simply involves a zoom operation,re-cluster using existing clusters.

(5) For a particular render pass, simply re-render a cluster (e.g., afoundation) if its entity set has changed.

(6) Locate and remove any duplicate visual entities. For example, ifmultiple map entries are created for a single business entity, all butone of the entries can be removed from the system.

While certain embodiments are discussed herein with reference toutilizing a flyout to disambiguate clustered entities, this is notintended to be limiting. In some embodiments, a user interaction with afoundation can cause a zoom-in operation that reveals individualentities included in a cluster. For example, when a user interacts witha foundation included as part of a display view, the display view canautomatically zoom-in on the area of the foundation such that the visualentities represented by the foundation no longer overlap and aredisplayed as separate visual entities.

Alternatively or additionally, in some embodiments user interaction witha foundation can cause a list of entities represented by the foundationto be presented. For example, when a user interacts with a foundationincluded as part of a display view, a list of entities represented bythe foundation can be displayed in a window that is included as part ofor is adjacent to the display view.

Having described example ways of constructing and interacting withclusters, consider now various embodiments that illustrate example waysof using annotations to indicate overlapping data sets.

Representation of Overlapping Visual Entities

In at least some embodiments, overlapping visual entities can berepresented via a combined visual entity. In some example scenarios,overlapping visual entities can be associated with multiple data setsthat can be layered to create a display view. For example, as discussedabove with respect to a mapping scenario, multiple layers of map datacan be overlaid to generate a particular map view. To aid in visualizingmultiple layered data sets, annotations for visual entities can beutilized.

FIG. 13 illustrates one example implementation of using annotations tovisualize multiple layers of data sets according to some embodiments. Afirst layer view which includes multiple visual entities is illustratedgenerally at 1300. In this particular example, first layer view 1300includes multiple visual entities that represent restaurants in aparticular geographical area, as illustrated by the “R” icons. A secondlayer view is illustrated generally at 1302 and includes multiple visualentities that are different from those illustrated in first layer view1300. In this particular example, second layer view 1302 includesmultiple visual entities that represent business entities that accept aparticular payment method (e.g., a particular credit card), asillustrated by the “$” icons. An overlapping layer view is illustratedgenerally at 1304 and includes visual entities from first layer view1300 and second layer view 1302, as well as combined visual entitiesthat represent overlap between the layer views. For example, a combinedvisual entity 1306 represents overlap between first layer view 1300 andsecond layer view 1302. In some embodiments, combined visual entity 1306represents a restaurant that accepts the particular payment methodindicated by the “$” symbol. In this particular example embodiment, thevisual entity that represents a restaurant is annotated with the “$”symbol to indicate overlap between the different layers.

In at least some embodiments, methods discussed above for formingclusters can be utilized to determine when annotations should be used toindicate overlapping data sets. For example, the technique discussedabove with respect to FIG. 8 can be utilized to determine that visualentities associated with multiple different data sets overlap. A visualentity can be displayed with annotations to indicate the overlap of themultiple visual entities.

In some embodiments, a combined visual entity can include a foundation.For example, a foundation can be displayed with annotations to visuallyindicate that multiple visual entities (e.g., in multiple data layers)overlap. Responsive to a user interaction with the annotated foundation,a flyout can be presented that displays the separate visual entitiesthat are represented by the annotated foundation.

FIG. 14 displays an example combined visual entity in accordance withsome embodiments, generally at 1400. Combined visual entity 1400includes a primary visualization 1402 and annotations 1404, 1406, and1408. In this particular example embodiment, primary visualization 1402represents a business entity associated with lodging. The annotationsrepresent other data layers that overlap with the primary visualization1402. For example, annotation 1404 represent a coffee shop, annotation1406 represents an entity that accepts a particular payment method, andannotation 1408 represents a dining establishment. Thus, combined visualentity 1400 presents a visual indication of an overlap between theseparticular data sets.

Alternatively or additionally to the symbol and/or character-basedannotation of a combined visually entity, color can also be used as avisual indicator for a combined visual entity. For example, a particularcolor can be associated with a particular overlap of visual entitiesand/or data layers and can indicate to a viewer that the combined visualentity represents the particular visual entities.

FIG. 15 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. In some embodiments, the method can beimplemented to register visualizations that can be used to indicateoverlapping data sets. Step 1500 registers a default visualization for avisual entity. According to some embodiments, the default visualizationcan be used when the visual entity is a primary visualization for aparticular region of a display view. Step 1502 registers an annotationfor the visual entity. In some embodiments, the annotation can be usedto annotate a primary visualization for a different visual entity toindicate overlap between the visual entity and the different visualentity.

FIG. 16 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. As discussed above, in some embodimentsvisual entities may be associated with different layers of data. Thus,at least in some embodiments the method can be utilized to render acombined visual representation of entities from multiple different datalayers. Step 1600 ascertains a position for each visual entity to berendered. As discussed above, in some embodiments the position can be interms of a screen position (e.g., an x-coordinate, a y-coordinate, andso on), geographical coordinates, and so on. Step 1602 determines thatmultiple visual entities overlap. Step 1604 retrieves a visualizationfor each of the overlapping visual entities. The visualization for eachentity can be a primary visualization and/or an annotation. Step 1606renders a combined visual entity that includes visualizations for themultiple overlapping visual entities. In some embodiments, the combinedvisual entity can include a primary visualization for one of theoverlapping visual entities and one or more annotations for others ofthe overlapping visual entities.

FIG. 17 is a flow diagram that describes steps in a method in accordancewith one or more embodiments. Step 1700 determines that multiple visualentities overlap. Step 1702 renders a combined visual entity thatincludes visualizations for the multiple overlapping visual entities. Insome embodiments, the combined visual entity can include a primaryvisualization and one or more annotations.

Step 1704 receives an indication of a zoom-in operation. In at leastsome embodiments, the zoom-in operation can occur responsive to userinteraction with an application such as a mapping application. Step 1706determines that a visual entity of the multiple overlapping visualentities no longer overlaps. Step 1708 removes the visual entity fromthe combined visual entity. In some embodiments, this step can includeremoving an annotation from the combined visual entity or replacing aprimary visualization associated with the combined visual entity.

While several of the example embodiments discussed herein are discussedwith respect to a map implementation, it is to be appreciated thatmethods, techniques, and visualizations discussed herein can be appliedin other scenarios without departing from the spirit and scope of theclaimed embodiments. For example, clusters can be formed that representgroups of data files, instances of media content, flow charts,schematics, groups of persons at a particular location, and/or otherentities to which the methods, techniques, and visualizations discussedherein can be applied.

Example System

FIG. 18 illustrates an example computing device 1800 that can be used toimplement the various embodiments described above. Computing device 1800can be, for example, computing device 102 of FIG. 1 or any othersuitable computing device.

Computing device 1800 includes one or more processors or processingunits 1802, one or more memory and/or storage components 1804, one ormore input/output (I/O) devices 1806, and a bus 1808 that allows thevarious components and devices to communicate with one another. Bus 1808represents one or more of any of several types of bus structures,including a memory bus or memory controller, a peripheral bus, anaccelerated graphics port, and a processor or local bus using any of avariety of bus architectures. Bus 1808 can include wired and/or wirelessbuses.

Memory/storage component 1804 represents one or more computer storagemedia. Component 1804 can include volatile media (such as random accessmemory (RAM)) and/or nonvolatile media (such as read only memory (ROM),Flash memory, optical disks, magnetic disks, and so forth). Component1804 can include fixed media (e.g., RAM, ROM, a fixed hard drive, etc.)as well as removable media (e.g., a Flash memory drive, a removable harddrive, an optical disk, and so forth).

One or more input/output devices 1806 allow a user to enter commands andinformation to computing device 1800, and also allow information to bepresented to the user and/or other components or devices. Examples ofinput devices include a keyboard, a cursor control device (e.g., amouse), a microphone, a scanner, and so forth. Examples of outputdevices include a display device (e.g., a monitor or projector),speakers, a printer, a network card, and so forth.

Various techniques may be described herein in the general context ofsoftware or program modules. Generally, software includes routines,programs, objects, components, data structures, and so forth thatperform particular tasks or implement particular abstract data types. Animplementation of these modules and techniques may be stored on ortransmitted across some form of computer readable media. Computerreadable media can be any available medium or media that can be accessedby a computing device. By way of example, and not limitation, computerreadable media may comprise “computer-readable storage media”.

“Computer-readable storage media” include volatile and non-volatile,removable and non-removable media implemented in any method ortechnology for storage of information such as computer readableinstructions, data structures, program modules, or other data.Computer-readable storage media include, but are not limited to, RAM,ROM, EEPROM, flash memory or other memory technology, CD-ROM, digitalversatile disks (DVD) or other optical storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium which can be used to store the desired informationand which can be accessed by a computer. Thus, whereas computer readablemedia may include signals per se, computer-readable storage media doesnot include signals per se.

Conclusion

Various embodiments enable overlapping visual entities to be groupedinto a cluster that can be opened to reveal individual entities thatform the cluster. According to one or more embodiments, a cluster isrepresented on a map or other application display by a visualrepresentation known as a foundation. A user can interact with thefoundation to cause the cluster to be opened to reveal a flyout thatincludes individual entities (e.g., geographic locations) that form thecluster. A user can also interact with an individual entity of theflyout to acquire more information about the individual entity. In atleast some embodiments, a foundation can be annotated to indicate one ormore entities in a cluster.

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above.Rather, the specific features and acts described above are disclosed asexample forms of implementing the claims.

1-20. (canceled)
 21. A system comprising: one or more processors; andone or more computer readable storage media storing computer-executableinstructions that that are executable by the one or more processors tocause the system to perform operations including: render a combinedvisual entity that includes a visualization for each visual entity ofmultiple overlapping visual entities; determine, responsive to receivingan indication of a zoom-out operation, that one of the multipleoverlapping visual entities no longer overlaps; remove one visualizationfrom the one of the multiple overlapping visual entities from thecombined visual entity; and replace a primary visualization associatedwith the one of the multiple overlapping visual entities and included aspart of the combined visual entity, with a different primaryvisualization associated with another of the multiple overlapping visualentities.
 22. The system of claim 21, wherein one or more of themultiple overlapping visual entities represents one or more geographiclocations.
 23. The system of claim 21, wherein the combined visualentity comprises one or more annotations.
 24. The system of claim 23,wherein the primary visualization corresponds to one of the multipleoverlapping visual entities and the one or more annotations correspondto others of the multiple overlapping visual entities.
 25. The system ofclaim 21, wherein the zoom-out operation is responsive to a userinteraction with a map view.
 26. The system of claim 21, wherein thecomputer-executable instructions are executable by the one or moreprocessors to cause the system to remove the one visualization byremoving an annotation from the combined visual entity.
 27. Acomputer-implemented method comprising: rendering a combined visualentity that includes a visualization for each visual entity of multipleoverlapping visual entities; determining, responsive to receiving anindication of a zoom-out operation, that one of the multiple overlappingvisual entities no longer overlaps; removing one visualization for theone of the multiple overlapping visual entities from the combined visualentity; and replacing a primary visualization associated with the one ofthe multiple overlapping visual entities and included as part of thecombined visual entity, with a different primary visualizationassociated with another of the multiple overlapping visual entities. 28.The computer-implemented method of claim 27, wherein one or more of themultiple overlapping visual entities represents one or more geographiclocations.
 29. The computer-implemented method of claim 27, wherein thecombined visual entity comprises one or more annotations.
 30. Thecomputer-implemented method of claim 29, wherein the primaryvisualization corresponds to one of the multiple overlapping visualentities and the one or more annotations correspond to others of themultiple overlapping visual entities.
 31. The computer-implementedmethod of claim 27, wherein the zoom-out operation is responsive to auser interaction with a map view.
 32. The computer-implemented method ofclaim 27, wherein removing the one visualization comprises removing anannotation from the combined visual entity.
 33. The computer-implementedmethod of claim 27, wherein the one of the multiple overlapping visualentities can alternately be represented by the primary visualization oran annotation.
 34. A system comprising: one or more processors; and oneor more computer readable storage media storing computer-executableinstructions that that are executable by the one or more processors tocause the system to perform operations including: render a combinedvisual entity that includes a visualization for each visual entity ofmultiple overlapping visual entities; determine, responsive to receivingan indication of a zoom-in operation, that another visual entityoverlaps with one of the the multiple overlapping visual entities; add anew visualization associated with the another visual entity to thecombined visual entity; and replace a primary visualization in thecombined visual entity with a different primary visualization associatedwith the new visualization.
 35. The system of claim 34, wherein one ormore of the multiple overlapping visual entities represents one or moregeographic locations.
 36. The system of claim 34, wherein the combinedvisual entity comprises one or more annotations.
 37. The system of claim36, wherein the one or more annotations correspond to the visualizationfor each visual entity of the multiple overlapping visual entities. 38.The system of claim 34, wherein the zoom-in operation is responsive to auser interaction with a map view.
 39. The system of claim 34, whereinthe computer-executable instructions are executable by the one or moreprocessors to cause the system to add the new visualization.
 40. Thesystem of claim 34, wherein the new visualization is also be representedby an annotation in the combined visual entity.